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ABSTRACT 


One list of 16 verbal discrimination (VD) pairs was composed. Pairs 
were heterogeneous with respect to background frequency of occurrence 
of the words. Half the pairs were constructed of similar words and half, 
dissimilar. Correct responses for three groups of subjects were high- 
frequency words correct, low-frequency words correct, and half high- 
frequency and half low-frequency words correct. Analysis showed that 
learning the latter list was significantly more difficult than learning 
the high frequency correct or low frequency correct lists. Results of 
the experiment were consistent with that which would have been predicted 
by the frequency theory of VD learning, or the use of contingent un- 


certainty from information theory. 
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I, INTRODUCTION 


Frequency theory of verbal discrimination learning (Ekstrand, 
Wallace , and Underwood 1966) suggests that the difference in frequency 
of occurrence between the correct and incorrect response developed 
during an experiment acts as a cue upon which discrimination is based 
(Kausler and Farzanegan, 1969). Attneave (1953) has shown that a 
Significant correlation exists between the frequency of occurrence of 
letters and a subject's judgment of their frequency of occurrence. 
Considering the frequency theory in conjunction with Attneave's 
experiment , preexperimental word frequency differentials may be 
considered as a variable in intra-item discrimination. 

To facilitate exposition, the letters H and L will be used to 
designate the high and low preexperimental frequency of words. The 
first-second sequencing of these symbols indicates the preexperimental 
frequency of right and wrong words, respectively. Therefore, HL 
indicates a verbal discrimination pair wherein the high frequency word 
is the correct response. The symbol LH indicates the converse. The 
symbol LH-HL indicates a pair wherein the probability that the high 
frequency word is correct is equal to the probability that the low fre- 
quency word is correct. Verbal discrimination lists composed of HL 


pairs are termed HL lists, etc. 





Either frequency theory or information theory may be utilized to 
explain the relative difficulty of learning HL, LH, or LH-HL lists. Both 
theories assume that the subject is capable of discerning the intra-item 
frequency differential. Frequency theory indicates that an HL list is 
the simplest since rule 1, the more efficient according to Ekstrand, 
Wallace and Underwood (1966) applies. Rule 1 states "Select the word 
with the highest frequency of occurrence." Rule 2 applies to the LH 
list. This rule states "Select the most frequently occurring word and 
respond with the other word." Inthe case of the LH-HL list neither 
Rule 1 nor Rule 2 applies, and the subject must resort to rote learning. 

Information theory provides a means of expressing the additional 
stimulus yielded by the manner in whicn an experimenters -elects the 
correct responses of heterogeneous items within a verbal discrimination 
list. Contingent uncertainty, U(x:y), is defined by Garner (1962) as the 
extent to which the uncertainty has been reduced by the correlation be- 


tween random variables X and Y. Therefore, 


U(x:y) = [Wee sel a7) z U(x sy) 


where Umax(x,y) is the uncertainty which would be obtained if there 
were no correlation between X and Y and U(x,y) is the actual uncertainty 


that exists between X and Y. Uncertainty in the univariate case is 





defined as 
n 
Ul) =- 2. pe;) logy ple) 
i=1 
and in the bivariate case 
n m 
U(x,y) = -> 4 P(xi> yj) logy p(xi, Y3) 
i=l j4=1 
where p(xj) and p(x;, y ;) are the probabilities of occurrence of event x; 
or the joint occurrence of x; and y }? respectively. 

In the case of the HL and LH lists the contingent uncertainty equals 
the original uncertainty about the correctness of selecting the high or 
low frequency word and therefore indicates all uncertainty about the 
correct answer may be removed after the first trial. . In the case of 
the LH-HL list Umax (x,y) will equal U(x,y) indicating the subject cannot 
use the acs differential to reduce his uncertainty about the correct 
answer. 

Figures 1 through 4 represent joint probability matrices from which 
Uy ax (x,y) and U(x,y) may be determined, assuming the subject's choices 
of high and low frequency words are equally likely. By use of the bivariate 
uncertainty formula and the joint probabilities contained in Figure 1, 
Umax (*,y) may be calculated 
2 


2 
Umax (x,y) iz 242: 


-4(.25 log, .25) 


pl» ¥3) log Peis ¥5) 


= -logg .25 = log.4 = 2 bits 





In a similar manner U(x,y) for the HL, LH and LH-HL lists may be 


computed and established equal to 1, 1 and 2 bits respectively. 


EIGURE i: 


Joint Probability of Frequency Quality and 


Correct Responses for the Zero Correlation Case 


Words Words 
Correct Response eS MAS: 
Incorrect Response wae BOS, 
Pigs) we a 


FiGie: 2, 
Joint Probability of Frequency Quality and 


Correct Response in the Case of the HL List 


Xx 
High Freq. Low Freq. 
Words Words 
Correct Response Me. 0 
Y 
Incorrect Response 0 a, 
P(x) = oe 


P(y) 


ae 





FIGURE 3. 
Joint Probability of Frequency Quality and 


Correct Response in the Case of the LH List 


Xx 
High Freq. Low Freq. P(y) 
Words Words 
Correct Response 0 oo ss 
Y 
Incorrect Response BBS, 0 a. 
P (x) ao sa 1,0 
FIGURE 4. 
Joint Probability of Frequency Quality and 
Correct Response in the Case of the LH-HL List 
ee a 
High Freq. Low Freq. P(y) 
Words Words 
Correct Response Bs) RES, 52 
y 
Incorrect Response 5 AS 20 a, 
P(x) Ae, o 0 


Therefore the contingent uncertainty, U(x:y), with respect to the 
HL and LH lists equals 1 bit. This is by definition the amount of un- 
certainty reduction the subject may attain by using the frequency 
differential stimulus. Since the original average uncertainty about the 
correct response was I bit, the subject may reduce his average un- 


certainty to zero on completion of the first trial through the use of 


10 





the frequency differential stimulus. In the case of the LH-HL list, 
the contingent uncertainty equals zero since Uma, (x,y) equals U (x,y). 
Therefore, the subject cannot reduce the original average uncertainty 
by use of frequency differential as a stimulus. 

Using the foregoing notions, this study will examine the learning 


of verbal discrimination lists of the types HL, LH, and LH-HL. 
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II. METHOD 


A. WORD LISTS 

One master word list of 16 discrimination items was constructed. 
These words were selected from categories having at least a .9 
correlation over test subjects in the category norms for verbal items 
compiled by Battig and Montague (1969). An intrapair similarity was 
established by selecting the words of an item from a single category. 
Eight discrimination items were composed in this manner. The re- 
maining 8 items were selected such that elements of the items were 
contained in different categories. Each pair formed contained one 
high and one low response frequency word as indicated by the Battig 
and Montague norms. In addition, the frequency of occurrence of the 
word in written material was examined using the Thorndike and Lorge 
(1944) general count. In this respect, high response frequency words 
were required to be members of the AA to A group and low frequency 
response words members of the 1 to 20 group. This reduced the effect 
of written and spoken word frequency differences. The master list 
1s shown in Figure 5. 

Correct responses for the HL and LH lists were automatically 
established by the relative frequency of the word pairs. The correct 


responses for the LH-HL condition are shown in Figure 6. Four 


i 





random arrangements of the master list were constructed to reduce 


cues by position. 


FIGURE 5. 
Master List 


Word List for LH and HL Treatments 
High Frequency Low Frequency High Frequency Low Frequency 


Word Word Word Word 
Door Swan Roof Zinc 
Book Fog Shoe Cab 
Hill Gorge* Dog Skunk* 
Salt Herb* Glass Prune 
Nail Wedge* Milk Niece 
Coat Seaie Word Jerk 
House Cough Red Beige* 
Fly aaick* Leg Lung* 


* Denotes similar word paixs. 


FIGURE 6. 


Word List for LH-HL Treatment 


iis b> 

Correct Wrong Correct Wrong 

Response Response Response Response 
Door Swan Roof Zinc 
Book Fog Cab Shoe 
Gorge Hill Dog Skunk 
Herb Salt Glass Prune 
Wedge Nail Niece Milk 
Scarf Coat Jerk Word 
House Cough Beige Red 
Ely Tick Leg Lung 


** List 2 was composed by making the incorrect response 


of List 1 the correct response in List 2. 
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B. DESIGN 

Each discrimination item was considered to be a1 x 2 matrix having 
a uniform probability for the first selection. All responses were recorded. 
The basic experiment conformed to a completely randomized design with 
subjects assigned randomly to the three treatments (HL, LH, and HL-LH) 
and trials to criterion the variable measured. To evaluate changes in 
performance of subjects over trials, the experiment conformed to a 
three factor, mixed design with repeated measures on two factors 


(similarity and trials). 


C. *SsUuBjEGIS 

The 48 subjects were graduate level students in the operations 
research curriculum at the U.S. Naval Postgraduate School. The subjects 
were volunteers and were randomly assigned to the three treatment 


groups. 


D. PROCEDURES 

Following an explanation of the subject's task and procedures, subjects 
were tested individually using a Lafayette high-speed memory drum. The 
discrimination item was presented for a presentation time of 2 seconds 
followed by a 2 second interitem interval. The declaration was reinforced 
with the verbal response "correct" from the experimenter when the right 
word was chosen; otherwise, there was no response. There were no 


inter-trial breaks. Word choices were recorded for a minimum of six 


14 





trials or until a subject performed two successive perfect trials. 


Starting lists were randomly selected. 


15 





Il. RESULTS 


The first result to be shown is that the initial choice between high 
and low frequency words in an item is equally likely and that the maximum 
uncertainty is equal to 2 bits for any of the three conditions. It will also 
be shown that the contingent uncertainty for the LH-HL list is zero. 
Finally the trials to criteria and the learning trend over the first six 
trials will be analyzed. Table I. shows the high frequency and low frequency 
word choices on the first trial for all treatments and the chi-square test 
statistics testing the null hypothesis that choices between high and low 
frequency words are equally likely. The null hypothesis was not rejected. 
With this established, the contingent uncertainties previously calculated 
are confirmed. 

Tac E 1. 
Chi-Square Analysis of High and Low 


Frequency Responses from the Three Treatments 


Treatment Sample Number of Number of Chi- dvi. Cxricical 
Size High Freq. Low Freq. Square Value at 
Responses Responses Statistics joke le 
HL 256 135 128 soo2 1 3. 84 
LH 256 139 117 945 i 3. 84 
LH-HL 256 149 113 it iL 3. 84 
Pooled X e037 3 Fest 
Total 768 417 Soll 2.84 if 3.84 
Differences . 197 yy SSP, 
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Table II. displays the Chi-Square test statistics testing the null 
hypothesis that the probability of selecting a correct response equals 
0.5. The null hypothesis is not rejected. This indicates that the manner 
in which the correct responses were selected does not give any significant 


advantage of selecting the correct answer on the first trial to any group. 


AWNeieS 10 
Chi-Square Analysis of Correct and Incorrect 


Responses for the Three Treatments 


Treatment Sample Number of Numberof Chi-  d.f. Critical 
Size Correct Incorrect Square Value at 

Responses Responses _ Statistics p=.05 

HL 256 135 Al . 382 1 3.84 

LH 256 117 ie ~ 945 if 3. 84 

LH-AL 256 117 139 945 1 3. 84 

Pooled X* R272 oe el 

Total 768 evi S97 44 il 3.84 

Difference 1.832 2 So? 


The percent of correct responses per trial for the first six trials 
by treatment is shown in Table III. Figure 7 is a graphic presentation 


of these data. 


it7 





xe LE Iil, 


Percent of Correct Responses Per Trial by Treatment 


TREATMENT 
Trial HL LH LH-HL 
it Dao 45.7 45.7 
2 69.9 Goa 59.4 
3 80.9 67.9 64.5 
4 7.1 87.5 69s 
5 waa 89,4 75.8 
6 96.8 oF Jars 


Table IV. reveals the percent of correct responses over the first six 


eS =| i ae 5S aes Si = 5 a 
tHiats fox Similar and ceeeamilar words by treatment. 


AW -053 om ate 
Percent of Correct Responses for Similar and 


Dissimilar Words by Treatment 


Trial TREATMENT 
ae — ee 
_Sim Dis Sim Dis Sim Dis 
il 49,2 54.7 48.4 43,0 49.2 41.2 
2 71.9 68.8 63.3 64.1 56.3 62.5 
3 81.3 80.5 68.8 76.6 64.8 64,1 
4 88.3 85.9 85.9 88,3 67.2 71.1 
5 94.5 93.0 87.5 91.4 IES ON Te 
6 97.7 95.3 93.8 89,9 78.1 80.5 
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The data were analyzed first using an analysis of variance over the 
treatments using trials to criterion as the measured variable. Results 


are shown in Table V. 


TARIGE. V. 


Analysis of Variance Over Treatments 


Source Ss df MS Ie P 
Total ly pee 47 

Word List 386.0 2 £93.20 ASIA << 008 
Ervex wal, 3 45 eos 


The mean number of trials to criterion for the HL, LH and LH-HL 
lists were 7. 36, 7.98 and 13.61 respectively. Application of Tukey's 
HSD test (TS=3.1) indicated the means of the HL and LH lists equal and 
the mean of the LH-HL significantly different at the .01 level. 

In order to analyze the trend effects across trials and the effect of 
similarity an analysis of variance was conducted using repeated measures. 
The basic datum used was the ratio of correct responses to total responses 
per trial calculated separately for similar and dissimilar word pairs. 
Based on Underwood and Freund's (1970) work, six trials were considered 
sufficient to observe trends in the results. Since the data were ratios, 
the transformation X = 2 ARCSIN ~|ratio , as recommended by Kirk (1968), 


was utilized. Within this analysis, word lists were considered a between 


20 





subjects effect. Similarity and trials effects were considered within 
subjects effects. Results of this analysis are contained in Table VI. 

As would be expected, the effects of word lists and trials were 
significant. Also, the analysis shows the word lists were learned at 
different rates. This is evidenced by the fact that the lst by trials 
interaction was significant at the .05 level. The effect of similarity 
proved to be insignificant. The F statistic in this case seems extremely 
low. However, an F statistic of the value shown or smaller has a P value 
between .2 and .25. 


TAB TEey 1 


Analysis of Variance Over Trials 





PAN 


Source So. df MS le 2 
Total 136.8406 575 

Between Subjects 29. 3738 47 

Word List A 9.8872 2 4, 9436 77 <0US 
Error 19, 4861 45 . 4236 

Within Subjects 107.4673 528 

Similarity B 0054 1 0054 0403 n.S. 
Trials C 56.8074 5 11, 3614 87 TS ice O0 
AXB 0483 2 .02415 S29 n.S. 
AXC 2.4475 10 . 2447 189 ee, 2105 
BXC . 0181 5 . 0362 . 674 n. S. 
AXBXC . 723 10 05723 1.009 n.s. 
EBrror ! 5.9214 45 . 1316 

Peron 2 Phe AAW eee Rs, Pao as. 1295 

Exrox 3 BH Savor 225 0564 





IV. DISCUSSION 


This experiment has demonstrated that preexperimental frequency of 
words may be used in a facilitative manner during a verbal discrimination 
task. This result is consistent with that predicted by an extension of the 
frequency theory (Ekstrand, Wallace, and Underwood, 1966) and that pre- 
dicted by information theory. It should be noted that both of these 
theories require that the subject be able to discern the relative frequency 
difference in each item. If this is not possible the subject must resort 
to strict rote memory and develop the differential frequency cue during 
the experiment. 

In the case of the HL and LH lists, Rules 1 and 2 ot frequency theory 
provide a menas of performing intrapair discrimination with Rule 1 being 
regarded as the more efficient. The significant list by trials interaction 
and the curves of Figure 7 suggest the rules were effective in this case. 
The percent correct curve of the HL treatment is typical of a negatively 
accelerated, rising learning curve. The curve for the LH group indicates 
an unevenness that suggests that the dominant tendency (Rule 1) must be 
suppressed before Rule 2 becomes effective. The LH curve does not indi- 
cate that the experimental frequency differential interferred with the use 


of preexperimental frequency differential as a cue for discrimination. 


Ze 











The experiment did not indicate a significant effect due to similarity 
of words inanitem. This is most likely the result of the dominance of 
the intrapair frequency variable. 

Subjects were not informed of the high correlation or lack of correl- 
ation of correct response to background frequency prior to the experiment. 
Upon completion of the experiment no subject stated that the frequency 
difference had been noted. However, the results indicate that the stim- 
ulus provided was used to facilitate learning. 

Unlike the findings of Kausler and Farzanegan (1969), who did not 
examine the effects of list on first trial choices, this experiment shows 
that the probability of selecting a correct answer on the first trial is 
not significantly different for each of the treatments. Combining this 
finding with the statistically different rates of learning across trials 
for the treatments leads to more conclusive support that the frequency 
differential provides a dominant cue in verbal discrimination tasks. 

Contingent uncertainty may be used to advantage in that it provides 
a quantitative measure of the correlation of the stimulus, background 
frequency in this case, with the correct response. Since a dominant 
stimulus in the verbal discrimination task may be the differential fre- 
quency cue, contingent uncertainty relates the difficulty of the verbal 
discrimination of heterogeneous items to their preexperimental differen- 


tial frequencies. 


Z3 
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Considering that the application of frequency theory or contingent 
uncertainty presupposes the subject's ability to differentiate with respect 
to relative background frequencies, a fruitful area for future research 


would be to study the threshold for such differences. 
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V. SUMMARY 


One list of 16 verbal discrimination (VD) pairs was composed. Pairs 
were heterogeneous with respect to background frequency of occurrence 
of the words. Half the pairs were constructed of similar words and half, 
dissimilar. Correct responses for three groups of subjects were high- 
frequency words correct, low-frequency words correct, and half high- 
frequency and half low-frequency words correct. Analysis showed that 
learning the latter list was significantly more difficult than learning the 
high frequency correct or low frequency correct lists. Results of the 
experiment were consistent with that which would have been predicted 
by the frequency theory of VD learning, or the use of contingent uncer- 


tainty from information theory. 


pas 





APPENDIX: A 


SUBJECT'S INSTRUCTIONS 


You are participating in a verbal discrimination experiment. You 
will be shown a list of two word items, one word of which has been 
arbitrarily selected as correct. The list is 16 items long and will be 
repeated in various orders. It is your task to view the words and learn 
which one is correct. Once you have selected your word, announce it 
to the experimenter. You will have 2.0 seconds to view the words and 
2.0 seconds to make your response. If your response is correct the 
experimenter will tell you that you are correct, otherwise no answer 
will be given your respuuse. In each item, the correct response word 
will remain the same throughout the experiment. Trials will continue 
until a criterion of 2 successive perfect trials is achieved or through 
six trials, whichever is greater. 


Do you have any questions? 
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APPENDIX B 
CORRECT RESPONSES PER SUBJECT OVER TRIALS 
JEySl JOIRSM 
Subjects Il 2 3 4 5 6 7 8 Se ale 12 


iL 4 10 is ILS 16 16 


4 7 ie 14 16 16 16 


6 2 10 10 14 14 #35 14 Its iG 16 


ae a Sr a A SR mm 


7 g 12 9 14 ae 14 14 13 15 IS 16 16 


10 =6:10 7 11 kS 16 16 

JU > IY, IL iEs ILE 14 16 16 

ILA 8 11 12 aL 2 eZ 14 16 16 

3 i IY li. 3 14 15 15 IES) 16 16 

14 8 8 14 IS 16 16 

Mop ii “ 9 8 g eat is 14 ILS) 16 16 


16 8 2 = sles: ata eS 14 16 ILS, 16 16 
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APPENDIX C 


CORRECT RESPONSE OVER TRIALS BY SIMILARITY ATTRIBUTE 


LH LIST 
Similar Trials Dissimilar Trials 
me 3 5 ZS 6 
5 4 6 5 4 5 8 

oo S 2.5 3 7 5S 1 73 26 @ 
Seer OG & "S o> © 6 7 Sas 
a, o& 5 6 & 7 3 6 7 FG 
44665 6 4296 G76 
so &© 7 @& | 8 26 5 BS 
6 2 4 7 8 8 AS. (7 ote 7S 
wes / & 8x26 3. / 2 7 8 
oS & & 6 3 45 6 8 7 
aes % F 7 5 9°@ "7 Ge7 
m6 457 § 8 eA G7 6 
6 3 4 6 6 7 Qeee> 2 ore 
477 8 8 8 SW. C7 outs the 
oo 7 & 3S 3 7 6 6 8 
wey 7 FG 6S 8 a 7 S78 SS 
mo 2S & & 3 £6 7 8 @ 
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Similar Trials 
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HL LIST 
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Dissimilar Trials 
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LH-HL LIST 


Similar Trials Dissimilar Trials 
yee a 5 6 ie 2 3.4 5556 
5 7 6 4 6 7 
Jomee 5 7 8 So 5 6) 5) 5 Be 
fmf 66 CS Sy 5 (5 8 oeeG 
a a nS je: sos. 
Some 3 6 4 ABS: 55° 5: Boa 
77 7 8 6 6 6 7 6 6 
Zee 6 6 7 belo .5. 2 5 Ba 
A) ee | S 4 SF 36 7 
Yeese 6 5 7 1s ee fey Aaa 
Tome 6 68 68 De SS 5ie* Ve mw, 
443 4 5 21-8 5 69675 
our 7 2667 B G6 5 6° 7 Be 
Bowomea 5 6 be 7108, 6 Sie 
Seow 5 C65 8B 4°6 5 76 
fee / 7 95 So Oe. a! ae 
game C5lClCS 2A SiO eo \/ ey 
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APPENDIX D 


NUMBER OF RESPONSES BY WORD AND LIST ON FIRST TRIAL 
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